Competition between glassiness and order in a multi-spin glass 



J. A. Hcrtz a , David Sherrington 6 and Th. M. Nieuwenhuizen c 
a: NORDITA, Blegdamsvej 17 , DK-2100 Copenhagen, Denmark 
b: Department of Physics, University of Oxford, Theoretical Physics, 1 Keble Road, Oxford, 0X1 3NP, England 
c: Department of Physics and Astronomy, Valckenierstraat 65, 1018 XE Amsterdam, The Netherlands. 
(Version 29 April 1999; printout February 1, 2008) 



ON 

On 
OS 

CO 



I 

CZ5 



c 

o 

CN 

> 
co 

CO 



oo : 

Os . 
-I— > ' 

a ■ 

E 

T3 ■ 

c : 
o . 
o ■ 



X 



A mean-field multi-spin interaction spin glass model is an- 
alyzed in the presence of a ferromagnetic coupling. The static 
and dynamical phase diagrams contain four phases (paramag- 
net, spin glass, ordinary ferromagnet and glassy ferromagnet) 
and exhibit reentrant behavior. The glassy ferromagnet phase 
has anomalous dynamical properties. The results are consis- 
tent with a nonequilibrium thermodynamics that has been 
proposed for glasses. 
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Recent work has emphasized the importance of aging 
as a fundamental property of glassy systems and given it 
a precise meaning: While simple average quantities relax 
relatively quickly to stationary values, two-time quanti- 
ties (correlation and response functions) show that the 
system never truly equilibrates. Whenever the separa- 
tion between the two times is comparable with the age 
of the system or greater, time translational invariance is 
violated and the fluctuation-dissipation relation (FDR) 
is modified. These effects are a direct consequence of 
trapping in metastable attractors, and the modified FDR 
gives information about the overlap distribution of these 
attractors. This has been demonstrated explicitly for sev- 
eral soluble models 

However, in all these models the distribution of 
the quenched random variables is symmetric, so the 
metastable attractors lack interesting macroscopic struc- 
ture. This is not the case in a large variety of systems 
where biased, tuned, or trained interactions lead to coop- 
eratively ordered attractors, yet this macroscopic order- 
ing competes with significant quenched randomness and 
the consequent tendency toward glassiness. Examples 
of such systems include models for recurrent neural net- 
works |Q, error correction algorithms [0], combinatorial 
optimization |^-|^], and proteins as well as experi- 
mental spin glass materials with ferromagnetic, antifer- 
romagnetic or helically ordered phases fi"(i| . Equilibrium 
analyses of many of these have found replica symmetry 
breaking regions, indicative of glassy behaviour, in their 
phase diagrams, but so far their dynamics have not been 
studied. 

The purpose of this paper is to start to remedy this 
lack by solving a nontrivial model with both spin-glass- 
like and macroscopic attractors. We demonstrate that 
(i) the ferromagnetic part of the dynamical phase dia- 



gram contains both glassy and ordinary non-glassy re- 
gions (with aging present in the glassy one) , (ii) the two- 
time correlation function in the glassy ferromagnet in- 
volves non-analytic features absent in the zero-field spin- 
glass [[|. The results are in accord with a proposed 
non-equilibrium thermodynamic description of glasses 

EHS- 

For the model we discuss (a spherical p-spin glass 
[Plpd] 16 1 with a ferromagnetic interaction), we observe 
several interesting features of the phase diagrams (Fig. 
1). (i) For both statics and dynamics, they contain 
four phases: paramagnet, spin glass (with zero spon- 
taneous magnetization), conventional ferromagnet (non- 
zero spontaneous magnetization but no replica symme- 
try breaking or aging) , and glassy ferromagnet (non-zero 
spontaneous magnetization with replica symmetry break- 
ing for statics and aging for dynamics). All the phases 
meet at a multicritical point, (ii) The critical ferromag- 
netic exchange separating the spin-glass and glassy fer- 
romagnetic regions decreases with increasing tempera- 
tures, so that within a finite band of exchange interaction 
values there occurs a sequence of phases, with decreas- 
ing temperature, of paramagnet, ordinary ferromagnet, 
glassy ferromagnet and spin glass. This has been a regu- 
larly observed feature of experiment (referred to as "re- 
entrance" p0|), but is not found in equilibrium theory 
for conventional spin-glass models p7| . (iii) There is a 
finite maximum ferromagnetic exchange for glassy ferro- 
magnetism even at zero temperature for all finite p > 2 
|]l9| . (iv) The transition temperature separating glassy 
and ordinary ferromagnetic regions first rises and then 
falls as the ferromagnetic exchange is increased beyond 
its value at the multicritical point, thereby indicating 
re-entrance as the ferromagnetic exchange is increased 
within an appropriate temperature band, with the se- 
quence paramagnet, ordinary ferromagnet, glassy ferro- 
magnet, and back to ordinary ferromagnet. (v) The peak 
of the phase line separating glassy and ordinary ferromag- 
net also marks a boundary between two types of onset of 
one-step replica symmetry breaking (1RSB), discontin- 
uous for smaller ferromagnetic exchange, continuous for 
larger ferromagnetic exchange; c/. Q]. (vi) Wherever 
the onset of 1RSB is discontinuous, the dynamical tran- 
sition temperature is higher than the static one, as in the 
limit of zero ferromagnetic interaction |l4|,|l5|,^l| . 

We consider a model Hamiltonian 
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Ji 1 i 2 ..i p Si 1 Si 2 . 



ij i 



(1) 



with independently distributed random quenched p-spin 
interactions of mean zero and variance J 2 pl/2N P ~ 1 and 
nonrandom 2-spin interactions. The spins are subject 
to the spherical constraint J2i — N. Mean field the- 
ory is exact for infinite-ranged interactions. The choice 
of spherical spins simplifies the resulting self-consistency 
equations, while p > 2 ensures that one-step replica- 
symmetry breaking (1RSB) is sufficient. 
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FIG. 1. Static and dynamic phase diagram for the model 
with p — 4. When different from the dynamical ones, the 
static phase boundaries are indicated by bold lines. 

We have studied the model by two complementary ap- 
proaches. The first employs the replica formalism and 
permits us to obtain both the equilibrium and dynami- 
cal order parameters. It is characterized by three order 
parameters the maximum (self-) overlap gi, the mini- 
mum (mutual) overlap qo, the magnetization M and the 
amplitude (1 — x) of the self-overlap part of the over- 
lap probability distribution. The spherical constraint is 
ensured by a self-consistently determined Lagrange mul- 
tiplier. Stationarity of the replica free energy 

ij M 2 -I/3J 2 [l- (1- x)q\- 
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2x " ~ L1J 2(1 — (1 — x)qi — xqo) 

with respect to qo, qi and M yields the self-consistency 
equations 

M = {0H + f3J Q M)(l-q) 



(3) 
(4) 

qi - qo = m(! - g)(l - qijivT 1 - 9o _1 ). ( 5 ) 

where we have used the shorthands p = \p>/3 2 J 2 and 
q = xq Q + (1 - x)qi. 



For the equilibrium (static) theory, a fourth self- 
consistency condition is provided by requiring that the 
derivative 
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vanish. Eqns. (|3|j(j) are then solved for qg, gij M and x. 

To obtain the dynamical order parameters one em- 
ploys, instead of Eqn. (^J), the marginal stability con- 
dition [PU2TIJ2T 



b-i) W r 2 (i-gi) 
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As in the problem without a ferromagnetic term Jlif , this 
procedure yields the same order parameters and transi- 
tions that we find with our second approach, a direct 
dynamical analysis. 

That treatment starts from the Langevin equation 



dSi dH 

-dt=-ds i - z{t)Sl + mit) 



(8) 



where rji(t) is white noise of temperature T and z(t) 
has to be adjusted to satisfy the spherical constraint. 
Following and extending now-standard procedures |2l| 
of introducing a generating functional, averaging over 
stochastic noise and quenched disorder, introducing ap- 
propriate macroscopic time-dependent quantities and us- 
ing extremal analysis in the limit N — > 00, there result 
self-consistent equations for the local correlation function 
C(t,t') = (l/N) E,i{Si(t)Si(f)), the local response func- 
tion G(t,t') = (l/N) Y. l ^S l (t))/5H l (t')\ Hdtl)=H , and 
the global magnetization M(t) = (l/N) Ei(^( i )> : 

d t C(t, t') = -z(t)C(t, t') + 2G(t', t) + f3HM(t') 

+ l3J M(t)M(t')+fi f d* 1 O p - 1 (t,*i)G(t',t 1 ) 
Jo 

+ (p-l)fif dtiG(t,t 1 )C- 2 (t,ti)C(t 1 ,t / ) (9) 
Jo 



dt G(t, t') = -z(t)G(t, t') + S(t - t') 

+ (p-l)(ij &tiG{t,tx)C p -*{t,ti)G(ti,t') (10) 



d t M(t) = -z(t)M(t) +(3H + (3J M(t) 

+ (p - 1)a* / dt! G(t, h)CP- 2 (t, t!)M (t0 
Jo 



(11) 



Together with the spherical constraint C(t,t) = 1, Eqs. 
(p[]Tl]) determine the dynamics completely. However, 
even for Jo = H = 0, they have not yet been solved. We 
concentrate on long times, where z(t) and M(t) reach 



2 



stationary values and a self-consistent solution is possi- 
ble under the assumption that C(t,t') and G(t,t') have 
time-translation- invariant behavior for ft — t') <C t' and 
simple aging behavior for (t — t') ^> t' ID: 



C(t,t') = C st (t-t') + C ag (t,t'), 
G(t,t') = G st (t-t') + G ag (t,t'), 



(12) 
(13) 



where in terms of A = t'/t, C ag (t,t') = C(A) and 
G ag (t,t') = G(X)/t, with limiting values C st (0) = 1 — qi, 
C st (oo) = 0, C(l) = qi, and C(0) = q Q . Thus qi is the 
plateau value of C reached for 1 <C t — t' <C t', and go is 
its asymptotic (t — > oo) limit. In the stationary regime 
the conventional fluctuation-dissipation theorem 



dc at (t-if) 
at' 



= TG st (t-t') (t>t') 



(14) 



holds, while in the aging regime one has instead the mod- 
ified fluctuation-dissipation relation 



dC ag (t,t) 
dt' 



T e G ag {t, t') 



T 
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(15) 



i.e. dC(A)/dA = T e g(A). 

At long times the time-derivative terms on the left- 
hand sides of (H|]]) can be neglected. The asymptotic 
solution found in this limit for the aging regime admits 
a reparametrization invariance p4[ : if C(t, t') is a solu- 
tion, so is C(h(t),h(t')), with h(t) an arbitrary mono- 
tonic function of t. Thus we cannot find the complete 
time-dependence of C and G from the asymptotic equa- 
tions alone. Nevertheless, we can solve for M, x, qo and 
qi, finding the same results as were obtained above by 
the replica treatment in its 'dynamics' form. No further 
assumptions on C and G are needed to obtain these re- 
sults. 

We restrict ourselves to H — in this letter. Fig. 1 
shows the phase diagram of the model in T — Jo space for 
p = 4. The general features are not sensitive to p. For 
sufficiently weak ferromagnetic interaction Jo , we find the 
same results as for Jo = 0: a dynamical paramagnctic- 
to-spin glass transition at a temperature Td and a static 
transition at a lower temperature T g . The spin glass 
states (both dynamical and equilibrium) involve 1RSB, 
with qo = M = 0, and q\ is discontinuous at the transi- 
tions, where x — > 1. For J > Td (T g for statics), there is 
a Curie temperature T c , below which the paramagnetic 
state is unstable against the onset of spontaneous magne- 
tization. For a range of temperatures below T c this ferro- 
magnetic state has a nonzero spin glass order parameter, 
but no glassy properties (no RSB or aging): qi = qo. 
However, it is unstable, at low enough temperatures and 
not too large Jo, against the formation of a glassy ferro- 
magnetic state with nonzero M, qo, and q\ > qo (which 
implies aging). Below a temperature-dependent critical 
value of Jo, the ferromagnetism of this state becomes un- 
stable, and one recovers the simple spin glass phase. All 



four phases come together at the point Jo = T = Td 
(Jo — T — T g for statics). 

The upper boundary of the glassy ferromagnetic phase 
rises as Jo increases from Td (T g for statics) and reaches 
a maximum at J /J = y/p(p - l)/2[(p - 2)/p}^- 2 ^ 2 . It 
falls to T = at J / J = y/p(p - l)/2. To the left of 
the maximum, q\ — qo jumps discontinuously and x — * 1 
at the transition (as in the paramagnetic-to-spin glass 
transition at small Jo). To the right of the maximum, 
qi — qo goes continuously to zero at the transition, where 
x < 1, and the static and dynamical boundaries coincide. 
This part of the boundary is thus an Almcida-Thouless 
line like that found in the SK model f2f| , though the low- 
T states are different: here one step of RSB is exact, while 
full RSB is necessary in the SK model. The overall shape 
of the boundary is similar to that in the p-spin glass in 
an external field |~4]]ll| , though the relation between the 
two phase diagrams is not elementary because the order 
parameter equations are coupled. 

In the large-p limit, the dynamical small- Jo spin 
glass transition temperature Td approaches a finite limit 
l/y/2e. The glassy ferromagnetic phase extends out to 
Jo = Jp/V2, with its maximum temperature, 2Td/^/e 
achieved at Jo — Jp/(ey/2). The static spin glass transi- 
tion temperature T g at small Jo goes to zero like 1 / %/Togp 
fL6| , so the spin glass phase disappears, but the glassy 
ferromagnetic phase remains. 
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FIG. 2. Dynamical phase transition lines (solid) for the 
model with p—3, and lines of constant b in the glassy ferro- 
magnet. 

The glassy state is characterized by a plateau C = q\ 
in the correlation function, the length of which is age- 
dependent. The behavior near this plateau involves 
power laws. An exponent a characterizes the decay at 
the end of the short-time regime (the approach to the 
plateau): C(t + T,t) = C(r) w q\ +const/r a . Using Eqn. 
© in the FDT regime, we find an equation for a, 



T\l-a) _ (p-2)(l- ?1 ) 



T(l - 2a) 



2qi 



(16) 
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valid in both glassy ferromagnetic and spin glass phases. 
Thus, a is independent of Jo, since q\ is fixed by (0). 

For Jo = the asymptotic dynamical equations have 
the exact aging solution C(A) = A" (0 < v < 1) [Q, 
which also holds for Jo > in the spin glass phase. In 
the glassy ferromagnetic phase, C(A) is nonanalytic for 
A — ► 1, i.e., at the end of the plateau and the beginning 
of the aging regime. We make the Ansatz C(A) = 1 — 
B{1 - X) b + 0[(1 - A) 2b ] and find, using the result @, 
that the exponent b must satisfy 



T 2 {l + b) _ r 2 (l-q) 
; T(l + 26) ~~ r(l - 2a) : 



(17) 



Such an Ansatz was also employed in a different problem 
H, where the relation ( |l7j ) was also found. A similar 
result is expected to hold for a spin glass in a field, as 
well. At the boundary between the spin glass and glassy 
ferromagnetic phases, b — > 1, and along the AT line sepa- 
rating the conventional and glassy ferromagnetic phases 
6^0. Fig. 2 shows lines of constant b for the p = 3 
model. 

The system dynamically condenses into glassy states, 
characterized by x or the effective temperature T e = T/x. 
They have a configurational entropy (or complexity) 
UllHH 1 = -(dF/dT e ) T = (x 2 /T)(dF/dx) T , that 
follows from Eqn. (6). X is a positive constant in the 
spin glass [^6| , and, of course, it is zero in the ordinary 
ferromagnet. In the glassy ferromagnet it interpolates 
smoothly between these two values, and it vanishes at the 
transition to the ordinary ferromagnet, where Qq — ► q-y. 

The specific heat, defined as the limit of the energy 
difference between states obtained by rapid quenches 
to two slightly different temperatures, divided by the 
temperature difference, has two terms: C — dU/dT = 
TdSi/dT+T e dl/dT 0>||, with the intravalley entropy 
given by S\ = — (9F/9T)t c , viz. 

S 1 = \ ln(l - qi ) - \{(3J) 2 {\ + (p - l)gf - pqr 1 )- (18) 

This is exactly the entropy of a single TAP valley [ p6|j28| 
and describes states that can be reached dynamically at 
fixed T. In the spin glass and in the ordinary ferromagnet 
dX/dT = 0, so the specific heat merely follows from the 
intravalley processes. In the glassy ferromagnet, however, 
dl/dT < 0, so the specific heat (as defined here) acquires 
a (negative) contribution from changes in the shape of the 
free energy landscape with temperature. 

In summary, we have been able to elucidate explicitly 
the consequences of the competition between glassiness 
and ferromagnetic ordering in the statistical mechan- 
ics and long-time dynamics of an asymptotically soluble 
model. We have found several novel features and ex- 
tended and verified the applicability of concepts devised 
for spin glasses. These results can shed useful light on 
the many other important problems, in physics and other 
fields, where ordering competes with quenched disorder. 
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